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ABSTRACT 

Summarized in this report are the activities 
undertaken in the development\of the Classification of Secondary 
School Courses (CSSC) for the National Cejiter for Education 
Statistics* use in coding transcripts of high school students. 
Fifty-two secondary school course patalogs selected from those 
collected in the High School and Beyond stiidy provided almost 10,000 
course titles. These were classified according -to instructional 
prqgram areas as cfefined in the Classification of Instructional 
Programs, a postsecondary classification scheme. Each course title is 
provided a unique six^digit code and linked to keyword descriptors 
and alternate- course titles. This report covers the selection and 
activities of a 'review and recommend'ations p^nel supporting the CSSC 
project, tlie review of rfl^ted documents, , an analysis of the course 
catalog sample, specfial considerations ^n the development of the 
CSSC, a test of the reliability of the ;CSSC, and recommendations 
regarding methods for using the CSgc arid for further developing the 
CSSC or similar classifications. Appendices cover the compo.sition of 
the review and recommendations panel, the instructional program 
categories used, the distribution of .the bourse catalog sample by 
state, and cross-references between related categories in the 
classification. (Author/PGD) 
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ANNOUNCEMENT 

The National Center for Education Statlstlds (NCES) announces publication of: 

A aASSIFICATION OF SECONDARY SCHOOL COURSES: PROJECT SUMMARY REPORT 

This report was prepared by Evaluation Technologies Incorporated (ETI) of 
Arlington, Virginia' uAder contract with NCES, The report describes the * 
activities undertaken >y ETI in developing a (separately published) 
"Classification of Secondary School Courses" for use by NCES in a projected 
study of offerings and enrollments in American High Schools • 

This report describes: (a) the development of the Classification, (b) it 

• ♦ 

review by a panel of subject matter experts, (c) an empirical assessment of in 
tercoder reliability^ and (d) recommendations concerning the use .of the 
Classification. 

This report is available only through the ERIC system. (DSS will supply 
details). Additional informati^on about this report can be obtained from 
George H. Brown, Longitudinal St^^dies Branch, National Center for Education 
Statistics (Presidential Building), I^om 408, 400 Maryland Avenue, S.W., 

\ 

Washington, D.C. 20202, telephone (301) 436-6688. 

Information about the Center^s statistical progr^am and a catal6g of ^ES . 
publications may be obtained from 'the Statistical Information Office, National 
Center for Education Statistics, (Presidential, Building) , 400 Maryland Avenue, 
SW., Washington, D.C. 20202, telephone (3^) 436-7909. 
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IN"mODUCTION 



This final report ^summarizes the ac+jvP^les ^undertaken In the "development 
of a CI asslff cation of Secondary School Courses (CSSC). /TFfe Classification 
was' produced by Evaluation Technologies Incorporated (^Ti) for the National 
^Center for Education Statistics (NCESV'TlTKler contract number 300-81-0312, 
The Classification was developed .for use by fJCES In coding transcripts of 
high school students. ^ These transcripts were' col lected by NCES from 
schools participating In the High School and Beyond longitudinal study, 

Tjie CSSC Is an Inventory of secondary school courses taught nationwide. 
The course titles In the Classification' were tak^ from a pool of nearly^ 
10,000 course titles I'n a scientifically selected sample^ of secondary 
school course catalogs* The .secondary school courses are arranged* In the 
Classification according to Instructional pr^ram areas as defined by th^ 
Classification of Instructional Programs (CIP), p postsecondary classifica- 
tion *deve I oped by NCES. Each course title' Is further distinguished by a 
.unique six-dlgit code, keyword descriptors, and alternate course titles. ^ 

The activities central to the development of the CSSC are described In th^ 
fol lowing ^sections of this report v 

• Development of the Classification 

Review of the Classification by a panel of subject-matter 
specialists 

m Test of Inte^^-coder reliability using the completed 
Classification , ' . 

• Recommendations from the ETI^ project team to NCES on the use of 
the Classification. \ 



Further documentation Is provided fn several appendices: . 

• Compos I +1 on of the Review and Recommendations Panel 

• List Qf Instructional Program Categories from th^ CIP 

' • Dlstrlbutlon^of sample of local school catalogs by state 

• List of Cross Referejjces between categories within, the Secondary 
School Classification ^ • 



. DEVELOR^^NT OF THE aASSIF I CATION 
OF SECONDARY .SCHOOL COURSES 



A. SELECTION OF A REVIEW AND RECOMMENDATIONjS PANEL 

/ 

Before the development process began, a panej of twertty-four secondary 
school curriculum socialists' was selected. Through nominations peers, 
professional assocIa>(ons, and program specialists at the U.S. Department 
of Education, a poo! of can'dtdates was Identified who met such criteria as: 

• Knowledge of the (discipline as evidenced py an advanced degree 
or teachIng.e:Nt|)erlence ^ 

X 

• Knowledge of secondary school curriculum through experience as 
a secondary school teacher or administrator 

^ 

Awareness of the state of the discipline In terms of current 
and out-of-date course titles and content. 

The panelists were chosen to support the project team In the analysis of a 
sample of course catalogs and to review the draft Classification. A list 
of panelists and their areas of expertise Is found In Appendix At A sum- 
mary of their contributions to 'the Classification Is provided In Paragraph 
E below. 

B. REV lEW OF RELATED DOCUMENTS 

The esse represents titles of courses offered In grades 7 through 12 In the 
nation's secondary schools. Vocational, academic, and generaf courses 
offered for credit are Included. These titles were selected through a 
carefully designed process canblnlng a review of existing classifications 
of such courses and an analysis of a sample of local course catalogs., The 
expertise of the panelists was applied Jn the choice of titles and key- 
words, and In the placement of course titles within program areas. 



II-l 



The documents reviewed and their application to the CSSC-^re described 
briefly below. , • ^ , ^ . 



U The Clalstf Icatton of Instruction al Programs (CiP)^ _ ^ 



A postsecondary classification of Instructional '^ogram areas, not Individ- 
ual courses, the CIP greas an^d the. first ,four digits of Its six-dlgit nu- 
meric cod,e are the basis of the CSSC* Several CIP program areas were 
determined to pertain only to the postsecondary level.' Therefore, with the 
concurrence of panel* experts, no secondary courses were assigned to these 
program areas: Education (13),-* Engineering (14), Health Sciences (18), Home 
Economies (19), Military Technologies (29), and Science Tech riol ogles* (41). 
The CIP aggregates many related program areas ,at the four-dtgit level. ♦ 
Since the unit of analysis of the CSSC Is the Individual course X}f\Q, the 
esse has more volumes For example, the CIP has one four-digit p'rogram area 
called "History." The CSSC contains 69 Individual hljgtqry courses. A 
complete list ofXlP program categories Is provided In Appendix B. 

2. Other References , ' / 

'c ' ' ' 

The project team^ reviewed three other sourc^es for course titles and their 
program area affiliation during the development ^p^'ocess: 

• Standard Terminology for G^rrlculum and Instruction In Local and 
State School Systefns> Handbook VL This division of twenty sub-* 
Ject-matter areas and topics of Instruction proved to be a good 
reference for keyword descriptors. 

• A ppendix B of the 1972-73 Offerings and Enrollme nts Survey. An 
aggregated list of courses ano^ program titles offered In various 
schools!, this document alertecl the ETl project team to the var- 
lety of secondary school courses. 



1 ' * / ' 

Malltz, Gerald S. A Classification of Instructional Programs. U.S. 

Department of Education, Office of Education Research and Ijnprovement, 

National Center for Education Statistics, NOES 81-323, Washlpfgton, D.C. : 

U.S. Government Printing Of flee, 1981 . ' / • ^ 
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' • state TaxonomtQs. Tha I Is+s of courses from the states of Call- 
fornia, Washington, >and IM InoIs were used to augment the course 
titles selected from the sample of local school catalogs. 

C. ANALYSIS OF SAf-IPLE OF LOCAL SCHOOL COURSE CATALOGS 

A sample of 52 secondary school course catalogs, dated 1979 through 1981, 
was chosen by NCES from those collected. In the High School and Beyond 
Study. "^Private Independent, private Vel Iglously-af f I Hated, and public 
^schools were Included In H-he sample. The distribution of catalogs by state 
Is pr^senl^ed In Appendix C. 

Each course offered for credit was analyzed for Inclusion In the Classifi- 
cation. The goal of the analysts was to Identify unique course titles, 
match them with CIP two- and four-digit areas, select keyword descriptors 
to discriminate course content, and assign each unique i"ltle an equally 
unique six-dlgit code. 

The first project product, a course descriptive card file, was automated 
and then printed as a qatalog. This catalog contained 1513 course titles, 
and accompanying keywords, alternate titles, and six-dlgit codes arranged 
according to CIP program areas. It also contained a complete course title 

r 

Index. This product was Intended iP^Jrkii^e by the review panelists and was 

distributed to them before a twd=-day working meeting In April, 1982. 

* • 

The final CSSC contains all the recommend^,t^ons of. the panelists as to 
addl/l^jlonal course titles, corrected course titles, and keywords. In addl- 
tlon, at the two- and four-digit levels, the CSSC text contains descrlp- 
th'^e paragraphs for the Instructional programs as they are presented In 
the CIP. At the six-dlgit level. Individual courses are presented as In 
the sample below. 
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07.0631 Secretarial Administration 



Secretarial Practice; Secretarial Procedures; Secretarial 

Offic? Practice; Secretarial typewriting. Integrated; Secre- 

* • ' • ) 

tarlal Ski I Is, Integrated \ 



Secretariat occupatIoj)s; records management; human 
rejatlons; general office workflow; advanced typewriting; 
etiquette; Inforinatlon processing; texf editing ' 



The parts of a course entry are 
They are: 



Indicated by the tetters a, b, c, &nd d. 



a. Slx-Dlglt Code. Each eiyfry represent I ng 'a unique secondary course 
Is assigned a slx-dPglt code. The first four digits reading from 
left to right are taken from the CIP In all cases. Here the 07.06 
represents the CIP area "Secretarl-a! and Related Programs.^* The 
fifth and sixth digit provide a unique numeric code for the spe- 
cific course. 



b. Main Course Tlfle* A significant problem In gatherln'g course 
offerings data Is that a^varlety of possible titles can be used to 
Identify, a single course. The title occurring most -frequently In 
connection with a specific course was established as the. main 
course tltl^. 



c. Alternate Course Titles. These titles are variations on the main 
title used to describe a course with the same content. 
^ alternate titles have the same slx-dlg-It code as the main title 
under which they are listed. In this way, the CSSC aggregates the 
diverse course titles used In local schools to describe the same 
course. 
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d* Keyword 'Descriptors, These phrases are Intended to^ provide a 
^^description of the content of the associated course* The phrases 
* ^r^L adapfed from the course descriptions In local catalogs, 
enriched with panelists' recommendatlonSf 

During the analysis of catalogs and other references and fron the review of 
program areas by panelists, areas of overlap In Instructional programs were 
Identified. Therefore, the final CSSC contains a table of cross references 
fpr closely related programs. This table Is presented In Appendix D. 

0. SPECIAL CONSIDERATIONS IN THE DEVELOPNENT OF THE CSSC 

1. Cod In? Method'; 

There were' two methods used to assign numeric codes to course titles, at 
the fifth- and stxth-dlgit levels. When less than nine courses were found 
for any one four-digit program area, the fifth digit was, used as a course 
designator and the sixth digit ?s a course level Indicator,. When more than 
nine courses were found for any one four-digit program 'area, courses are 
numbered sequentially starting with "0" at the f Ifth-dlgl.1^ level and "1" at 
the sixth-dlqlt level. • ' 

2. The "Other" Qategory 

•within each four-digit Instructional program, area one six-djgit code was 
established to accommodate courses not specifically Identified In the CSSC. 
The code consists of the. four digits plus zeros In. the fifth and sixth 
^positions. The main titles used In the CSSC for these codes are the four- 

' digit level program titles followed by "other:" e.g., "Agriculture Services 
and Supplies, Other" (code: f)1.0500). 

3. Bl lingua It G'lfted.^^ n^ Special Education 

No special coding for courses designed for academically talented or special 
needs students Is Supplied In the CSSC, nor Is special coding available for 
courses taught In a language other than EngHsh. 

1 1-5 
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4 • V cy;at } ona i. ^tuc}^nt Organ ? 2 at 1 on - 

While It Is recognized that participation In vocatlongf student organiza- 
tions Is an essentia! part of many Instructional programs at the secondary 
level, the CS3C does not Include keyword descriptors to Indicate such par- 
ttclpatlon. 

E. ACTIVITIES OF THE REVIEW AND RE.COMMENDATIONS PANEL 

J \ * • 

I 

\ ' ^ 

The 'objective of the Review and Recommendations Panel meeting was to 
receive feedback from secondary education subject matter experts on the com- 
prehensiveness and representativeness of the The following para- 
graphs summarize the meeting format and purpose and the major Issues and 
reconmendatlons of the panelists, ; 

U M^^tlng pQr^iat gg^L Purpose 

The panel meeting was held at 'the Capitol, Park Internationa! Hotel In Wash- 
ington, D.C. on April 27 and 28, 1982. The major ^^y of the two days* meet- 
ing time was devoted to formal panelist presentations* Each of the twenty- 
four panelists spoke for appro>i:Imately fifteen minutes addressing his/her 
overall recommendations for revisions to th^^ Draft interim Course Catalog. 
Questions and reactions from other panelists and the .observers from NQES 
and other Department of Education offices followed each presentation. 

2. Ma jor Issu es of Paneitst Presontatlons x 

The twenty-four panallsts prepared written . recommendations for' specific 
changesi^to the Draft ^talog. These changes' wore' Included In summary form 
as part of their oral presentations during the panel meeting* A synopsis 
of the Issues and reccgimendattons Is presented below* 

• The panelists did' not view the course arrangement as a taxononyj^ 
therefore, they recommended the document be reentltled ^'Classifi- 
cation of Secondary ScHooS Courses." 

. 12 ■ , . 



• Concerned that the CSSC mfght be misused by extending It to ap- 
plications beyond. those for which It was designed, the panelists 
recommended that a note of caution on Its use be placed In the 
final document* ^ 

• Since secondary schools assign similar courses to different de- 
partments, the panelists recommended that a cross reference guide 
at the four-digit level be developed to assist coders and other 
users of the CSSC. 

• Concerned that consistent Information about different student 
populations enrolled In courses was not available, the panelists 
recommended excluding any Identification of courses by type, of 
student enrolled; e.g., special education, bilingual and/or 
gifted. 

•For many course titles, available keywords lacked specificity. 
Panelists corrected, added, and rewrote keyword descriptors based 
on their knowledge of course content. 

• The panelists noted that shifts In secondary school curricula 
continual 1/ occur. They recommended a periodic updating of the 
CSSC to maintain Its utility as a data gathering tool. 

The report on the panel meeting submitted by ETI Included a^chart of over 
200 revls-lorTs by type recommended by the paneMsts, and summaries of 
panelist contributions for each subjects-matter area. 
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Ml. RELIABILITY TEST OF TWE CSSO 

Jn order to examine the reliability of the Classification 'of Secondary 
School Courses, ETI designed and conducted a test of Inter-coder reliabil- 
ity. The following Is a summary of the training program, the reliability 
test plan, and the analysis plan and results. ' ^ 

A. CODER SELECTION AND TRAINING 

Four coders meeting the two criteria of having an American High school 
dlplcma and a minimum of two full years of college education ^ere selected 
and trained for participation In the rellabJIIty test of the Classification 
of Secondary School Courses. In an eight-hour training session, the coders 
were Instructed on how to assign six-dlgit codes to secondary course titles 
using the CSSC. The materials required for the session Included the traln- 
Ing outline, the completed CSSC, training protocols containing sample 
course titles for practice coding, a reminder list of special Instructions, 
and a diagram on "Making a Coding Decision." 

The training session began with a 50-mInute Introduction to the training 
session, the test and the Intended use of the CSSC In the NCES High School 
and Beyond longitudinal study. The next 30 minutes continued yith a page- 
by-page review of the CSSC, highlighting each section as to Information 
Included; such as the alphabetical Index, the Table of Cross' References, 
and the main body of six-dlgit coded courses. 

After a 15-mInute break, the coders were Introduced to the protocol to be 
used during the test, the 50 high school catalogs to he used as the source 
of the courses, and the coding procedure. The cocling procedure consisted 
of the cpder entering his/her name, start time, six-dlgit code chosen from 
the CSSC, noting any reference to high school catalogs, and recording time 
of completion. The coders were briefed on certain rules; such as, follow- 
ing the prescribed order of the protocols, refraining from discussing 
coding decisions among themselves, and completing the protocol on ?/hjch 
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they were working before taking a break or leaving for the day-. Code^s^". 
were given guidelines for coding tracked and levelled courses. After the 
lunch break, the coders spent the reraalnlng four hours on three Increas- 
ingly difficult practice trials and reviewed their coding decisions and 
problems with the trainers. 

B. RELIABILITY TEST 

The four coders then spent the remaining eight days maklnA 1,000 coding c 
decisions on 50 protocols. The course titles on. the protocols were ran- 
domly selected from a subsamp'Ie of 50 local catalogs obtained from NCES. 
If In doubt about a course title listed on a protocol, the coder was per- 
mitted to refer to the school catalog from which the course was selected 
and w^s Instruped to note this reference with a check on the protocol 
sheets Coding rof one protocol of 20 courses averaged 33 minutes. 

After the two-week testing^ period, an analysis of th]? results was com- 
pleted. The goals of J-he analysis were To obtain measures of the accuracy 
and Inter-coder rellaBlIIt/ of the coding, to assess the training effec- 
tiveness, and to summarize the coders' reactions- to the CSSC and to the 
coding task. The sources for data Included: (1) completed protocols on 
which coders' entered their classifications of the 1,000 course titles, (2) 

V 

respOiisesv to a coder feedback questionnaire, and (3) the test monitor^ 
observations and records of Interactions with the cpd6rs. In addition, 
fifty titles were selected for an accuracy check whereby the CSSC experts' 
coding decisions were comparea to those of the novices. 

The data were reported In several ways. First, later-coder rellaJ^IIIt/ was 
measured by ccmputlng the percentage of agreement on code selection at « the 
two-, four-, and six-dlgtt levels. Next, the number of classifications on 
which 3, 2 and no raters agreed was computed with a. difficult/ Index for 
each two-digit program area. The number of catalog references by, two-dIcfI;h 
area was also reported. Finally, the responses of the coders to a 
questionnaire on the training session were analyzed and sumSft^rlzed. - 
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Co'der accuracy was determined by comparing each coder^s responses on a 
sample of course titles to the correct 'classification of those titles by 
two esse e>jf/erts. The average percent of agreement 'for the three coders at 
the two-digit level was 83 percent; at the four-digit level 71 percent; and 
ati^ the six-dlgit level 43 percent. . . . . ' 

In+er-coder rellabillt/ was found to Jmprove between the beginning of the 
study (the first ten protocols) and the end of the study (the remaining 
protocols). Pair-wise averages computed showed a higher overall percentage 
of agreement anong the pairs of coders than between each ^ndIv^duaI coder 
and i-he experts. In fact. If decisions of two 9"+ of • three' coders are 
accepted as a satisfactory measure of reliability, the results of the test 
demonstrate agreement on a "unique code can be 'expected approximately, 90 
percent of the time at the slx-dlgl+ level, 98 percent of the time at the 
four-digit level, and 99 percent of the time at the two-dlgTt level. 

The analysis Of coder responses to the Feedback Questionnaire Indicated 
that the training provided all the Information needed to use the CSSC In a 
coding task. The coders recommended more comparative work be Included In 
the training sessions, as w6l I as pract-lce In using a ycross-ref erencj ng 
tool. The similarity of , courses and vagueness of some of the descriptors 
were problems^encountered by the coder^s. The tedious nature of the task 
was noted and suggestions made for Individual pacing and frequent breaks. 



/ 
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IV. RECOMMENDATIONS 



Throujghout the development process, problems surfaced and were discussed 
among the project team members with technical staff at NCES, and with the 
subject-matter specialists on the review panel^. These problems- led tb 
considerations of the methodology applied to the CSSC development, to the 
content of the CSSC, and to the future uses of the CSSC. 

A. METHODOLOGICAL CONSIDERATIONS ' . . 

A chief concern of the project tean In' building the Classification was the 
representativeness of the pool of course titles' from which we were 
selecting both titles and keywords. All .types of public and private 
schools were represented In the sample ch^^n by NCES. However, the number 
of private schools* was sn^all. The. project team would recommend that a 
larger, possibly stratlfTed, sample of such catalogs be used In any further 
efforts In building a new classification or updating^ the CSSC. 



V 



Once the maVn and alternate course titles., were selected, the. process of 
selecting keyword descriptors from the course catalogs raised Issues about 
the adequacy of the descriptions provided In* the catalogs. In many course 
catalogs, the description of course content was so general that literally 
no specific descriptors could be chosen for use by the project team. For 
many other courses similar descriptors were provided by the school making 
It difficult to discriminate between titles by content. 

Subject-matter specialists were consulted for assistance Iji choosing 
descriptors. The specialists were particularly helpful when they reviewed 
the draft Course Catalog of the CSSC. Many panelists rewrote keyword 
descriptors based or. their experiences teaching sIm 1 1 ar courses. Others 
analyzed written curriculum materials. Including textbooks, to select 
appropriate descriptors for courses taught with these materials. Because 
of the difficulties encountered In drawing keywords exclusively fron the 
ocal catalogs, the panelists and the .project team felt a wider distribu- 
tion of the titles and* keywords among specialists yielding a broader peer 
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evaluation of the descriptors would be recommended In either adding to the 
esse or developing any ^similar classifications. 

B. CONTENT CONSIDERATIONS ^ ' ^ I ^ 

I 

The review process also Identified possible content additions to the CSSC. 
A chief addition recommended by panelists was the length of time for which 
e^ch vcourse was of fered. Panelists maintained that the nature and content 
of cou^ses may differ with the length of course. The CSSC descriptors do 
not distinguish between quarter or full semester courses. Therefore, there 
Js nb, way to assess differences between courses based on length of* time 
taken. \ } 

\ ^ . 

The panelists were also concerned about distinguishing secondary sch^l 
program areas from program areas In postsecondary currlculu^ They 
recommended the elimination of those CIP program areas which would not 
represent secondary school ^^ttrflcul um. Other program areas at the- 
four-digit level were Identified by parcel Ists as cjosely related and even 
overlapping. The Interdisciplinary nature of many courses, and the variety 
of departmental placement possibilities displayed- In school catalogs were 
ctt^d as evidence that cross referencing, rather than arbitrary placement, 
was realistic. This recommendation was adopted and a cross reference table 
for^^closely related programs at the four-digit level ^s developed^ and 
added to the Introductory material In the final CSSC. ^ 



Finally, the project^^team was told by panelists and other specialists In 
secondary school curriculum that the Is constantly shifting, expanding In 
seme disciplines, and consol Mating In others. Therefore It was recom- 
mended that every few years a number of sample catalogs be chosen for an 
updating activity. The panelists maintained that even though the original 
purpose. of the CSSC will be satisfied In the coding of student transcripts. 
It will be Important to update the list of courses contained In the CSSC. 
Since the CSSC Is the most current classification of secondary school 
curriculum. It may be worthwhile to maintain It to meet the data collectt^i^ 
needs of researchers, curriculum specialists, and school administrators. 
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C. USES OF THE CSSC 

;A number of recommendations fbr the use of the CSSC. were Identified In the 
review panel meeting. T^ese are presented below together wl^tti lessons 
learned during the test of I^ter-coder rel labl I Ity. 

U Coding Student Transcript Data ^ ^ " 

- ■ ^- ■ ^ 

The primary purpose- of the CSSC Is Its application In the coding pf student 
"iranscrlpt data tor the High School and Bdyond study. The project team 

conducted a- test of Intercoder rellablllt/ to Identify the weak and strong 
.areas of the Classification as a coding tool. In. the process of training " ^ 

the coders and In conducting the analysis of test results a number of 

Issues concerning ^odfng behavior were noted. ^ 



a. Confusion over Lev$| Asslonfrient. Frequently coders agreed* at the 
four-digit level, but they varied In Interpretation of the course^ 
level Indicated by the fifth and sixth digits. One example of 
this .cdnfuslon concerned protocol 2, line 17, course title 
Economics. The codes assigned were 45.0602 Economics and Economic 
Pr Ob I ems ; 45 . 0601- Econcm 1 c Theory, Ba-s I c"; 45 . 06 1 1 Econom I cs, 

^College. a' similar sf^uatlon occurred In Protocol 3, ^Ine 12 
Environmental Biology and Protocol 4, Line 10 Practical Math. 

V 

« 

Recommendation^: A guideline sheet was developed and used during 
the training sesslori to help,. the coders dl'stlngulsh among, levels. 
In future training. Increased emphasis should' be placecf on^ 
reviewing the differences among level^. 

b. Classification of Vague Course Titles. Some courses had vague 
titles; for example, "Literary fff^Qhl Ights." The courdb description 
I ndl cated both Br j 1 1 sh and Amer I can 1 1 terature were covered. 
Since no code for such an al l-lnci usive course .v^s provided In the 
CSSC, coders agreed at the two-digit "Letters" level , but varied 
at the four- and six-dlgit levels. 
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Recommendation; Invariably such courses will be discovered In 
student' data. The coders can only be alerted to the possibility 
and then asked to place courses using the keywords, cpurse catalog 
descriptions and their best Judgement. ^s^. 

Classification of Generic Titles. In sane Instances, the CSSC 
uses the generic title. I.e., "Aquatics" Instead of a specific 
form of aquatics such as Skin Diving. The Protocol 38, line ]% 
sted the course title "Sk In D I v I ng, " Coders p I aced 1 1 under 
34sv0r61 Physical Education Leader^ihLp Tra],nlng, 36.0161 Aquatics 
and j^l. 0200 Outdoor Recreation, Other. 

Recommendation: Coders shoujd be trained to search for generic 
tl.-l^^s when the. specific course title Is not listed. A cross 
reference for generic titles could be addecj to th'e general list of 
cross references. \ 

Classification of Courses -wl>th Combined Concepts. Several courses 
combine concepts from two different program areas making It 
difficult to know whether to place the course In the main or 
related program area; for example, history, area studies, or 
multl/lnterdlsclpl Inary studies. This conflict Is reflected An 
Protocol 13, line 13 History arid Philosophy of Sciences, which was 
variously placed In 30.041 1 Humanities,. 45.0311 /<hchaeology, 
40.0100 Physical Sciences, Other. Similarly, Pro-foco! 6, line 14 
General Science^ was pi aced In 26.061 1 Ecology, ^^0.01 11 Science, 
Unified, and 26.0151 Field Biology. In the same manner^rotocol 
10, I Ine 1 American History, Ba^Ic, 05.0103 American Studies, 
General, and 45.0822 Amei;Jcan Inquiries. Finally In Protocol 10, 
line 4 Technology and Environment was placed In 30.0621 
Environmental Science, 03.021 1 Conservation and Rejgulatlon, anjd 
45.1131 Sociology, Issues. ^ / • \ 

1 

Recommendation: Examples of combined concept courses could be 
Included In the list of cross references*. 
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Discrimination Between Programs at the Two-Dtolt LeveL ^ 1 n some 
cases, courses were placed according to a course title that was 
listed/ but In a program that was not as appropriate* For example 
Protocol 3, \|lne 15 Cooperative Office Management was placed In 
07.0742 Office Education 2, Cooperative; 07..0741 Office Education 

M, Cooperative; '32,01 07 Cooperat I^Educatlon 2. The 07 Is the 
Business Program Category and the 32. Is Basic Skills under' 
"Personal and Social Development" Program Category. l<n a similar 
way/. Protocol 5, line 5 'World Civilization Is listed both under 

M5.08 History and 30,04 Humanities, and Social Sciences by 
different coders. ' * 

f 

Recommendation: The definition of some program areas needs to be 
reemphaslzed for the coders. The areas' of difficulty highlighted 
by trre difficulty Index should be emphasized during the training 
sessions. 

Confusion over Course Objectives, Many secondary school catalogs 
do not clearly-^ state the objectives of each course In the course 
description. For example, a course listed as "Drama" without 
accompanying objectives does not Indicate whether the course Is In 
the GeadTng of the drama, the writing of plays, or the acting of 
dramatic literature. The coders specif leal ly'^had difficulty^ with 
Protocol 6, line 8, Beginning Drama. This course was coded both 
as 23.01, r'bading of drama and 50.05, acting of drama* 

Recommendation: A tighter definition of four-digit program areas 
Is probably necessary. However; this Is beyoi^i the scope of the 
esse. The problems of definition within disciplines are most 
Hkely being reflected. In a lack of precision of course objectives 
and program areas within departments In secondary schools. 

Placemenf of Low Frequency Coursa Titles. Unusual titles are 
likely to provide difficulties for coders. For example, the 
course Peer Counseling, Protocol 6, line 17 was placed bV coders 
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In both 42.06 Counsel I ng Psychology and 33.01 Cltlzenshlp/CIvIc 
Activities. Both program areas may be appropriate for a course In 
which students learn the principles of counseling their peers and 
then Intern In a community-based peer counseling program. The 
unfemi I larlty of. such titles ylll make It dlfflcult^to locate 
them, especially If they have not ^been claimed by the particular 
disclpl Ine. 

» 

"^Recommendation: These unusual courses will Invariably be found In 
some student data. In the training session, coders should be 
alerted to such titles and be told tb use thfeir best Judgement In 
'their classification efforts. "* 

2. Providing a Model for Other Classifications 

Until Its development, the CSSC had no recent predecessor as a classifica- 
tion of public and private secondary school courses. During the develop- 
ment process the project team was advised 'that similar efforts would be 
useful for the elementary level curriculum and for a comparison of curric- 
ula across nations. The documentation provided at each stage of develop- 
ment of the CSSC-by the project team makes possible the development* of 
other classifications, 

•3. Clartf fcatlon of Course Location wit hin Program Areas , 

Provided that the' program areas used In fhe CSSC are meaningful to secon- 
'^ary school educators, the CSSC may be used to clarify" the locatfon of 
courses within departments or divisions. The CIP has been usedjn this Way 
by postsecondary educators planning addltFbnal curriculum and clarifying 
degree, programs for their students. The CSSC could be used as a similar 
reference. 

4. Data Collection a+ the Agg re gate op Disaggregate Level 

Researchers and school administrators frequently need Information about the 
number of courses offered across school districts as well as the number and 
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kinds of courses offered within depar-hnen+s at the school level. The CSSC 
provides enough detail — to the slx-dl^lt level — and basic cross refer- 
ences to permit data collection a\ the^^o- four- and slx-dlglt levels. 
The Information about breadth and depth' of course offerings may be useful 
In planning for cutbacks \or expansions within departments at the school 

lel'el and across school dlsttvlcts. ► 

< 

5. Tr(»nd Analysis 

\ 

.If tho CSSC Is updated -at perlod-fc Intervals, It may be useful for those 
anafyzlng the trends In course consolidation or expansion within program 
areas over t^me. Further Information provided In this type of analysis^ 
could be change In .course content, as evidenced by change In keyword 
descriptors. In coursie placement, and In new concerns wlth'^In disciplines. 

\ 

6. Articulati on Planning 

For those curriculum specialists or administrators concerned with the rela- 
tionship between eit^r Junior high school courses or postsecondary courses 
with secondary school courses, the CSSC couid.be useful. An examination of 
the types and levels of courses offered in various program areas could 
Indicate the variety of preparation of students going from one level to 
another. ' . , . 
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APPENDIX A: REVIEW'aND RECOMMENDATIOMS PANEL 



NAME 

» 

Clifford Nelson, Ph.D. 



AFFILIATION - 



University of Maryland 



POSITION 



Professor; Chairman, 
Department of Agricultural 
& Extension Ed. 



DISCIPLINE 



Agriculture 



John Brandt 



Penn. Dept. of Ed. 



State Supervisor, 
Vocational Education 



Architecture and 
Environmental 
Design, Trade 
and Industrial 
Ed, Engineering, 
Industrial Arts 



Jonathan Flint, Ph.D. 



Univ. of Pittsburgh 



Director of Educational 
Programs Ethnic Heritage 
Studies Genter-Untv. of . 
Pittsburgh; Assist, to 
Director, University 
Center for International 
Studies 



Area and Ethnic 
Studies 



Carl Jorgensen 



Virginia Dept. of Ed. 



Assoc. Dir. for Business 
Ed., Division of Vocational 
Ed. Program Services ' ^ 



Business jpnd Office 
Ed. 

\ 



Ray Vanderbllt 



Arlington, Va 
Publ Ic Schools 



Director, Arlington Schools 
Telecommunications Center 



U)mmun! canons 



Gerard Berry 



Fairfax County Public 
Schoo Is, An na nda I e ^ 



Computer Science* 
Curriculum Specialist 



Computer and Infor-^ 
matlon Science * 



REVIEW AND RECX3MMENDATIOl5s PANEL (Cont'd) 



Rose I ia Bannister 



AFFILIATIO N 



Eastern Michigan Unfv, 



PO SITIO N 



DIS CIP LI NE 



Director, Michigan Consumer Consumer Education 
Education Center 



Charles Hancock, Ph.D. 



University of Maryland 



Associate Professor Foreign Languages 

Foreign Language Education 



Sharon Redlck^ Ph.D. 



Ohio State University 



Associate Prof. 
Home Economics Ed. 



Home Economics 



Frances Kussell, Ed.Di 



0. 



Francis Roberts, Ph.D. 



Winchester Public Schools 
Winchester, Mass. 



Nat. Endowment for the 
Humanities 



Director of English, K-12 Letters, English 



Assist. Dir. for Elementary Liberal Studies 
and Secondary Programs (Humanities) 



Emmett Wright, Ph.D. 



Univ. of Maryland 



Director, Science Teaching 
Center 



Life Sciences 



John Kolb, Ph.D. 



North Carol I na State Univ. 



Prof, of Mathematics and 
Science Education 



Mathematics 



.Ray Smith, Lt.Col., Ret. 



Washington, D.C. 



Director, Military Science Military Sciences 
Department, Public Schools 
of D.C. 
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REVIEW AND RECOMMENDATIONS PANEL (Cont'd) 



MfiME 



AFFII lATION 



POSITION 



DISCIPLI NE 



Margaret Dabney, Ph.D. 



Virginia State University 



•i 



Coordinator, Secondary 
School Experfentlal 
Learning Project; 
Professor of Education 



Mul tidlsclpl Inary 
Studies 



Reverand WI 1 1 lam Wade 



St. Andrews Sewanee 
School 

St. Andrew' Sj, Tn 



Headmaster, St. Andrew's 
Sewanee School 



Phi losophy, 
. Rel Iglon and 
Theology 



Nina Roscher, Ph.D. 



American University 
Washington, D.C. 



Vice Provost for Academic 
Services; Dean for Faculty 
Affairs; Professor of 
Chemistry 



Physical Sciences 



Elena Sllepcevlch, O.P.E. 



Jane White, Ph.D. 



Southern Illinois Univ. 
Carbondale, 1 1 1 Inols 

r 

Univ. of Maryland ' 
Baltimore County 



Professor, Dept. of Health 
Education and School of 
Medicine 



Health Education 



Elementary Ed. Coordinator Social Sciences 



John Chrlstlano 



McQuald Jesuit High School Psychology Instructor 
Rochester, New York 



Psychology 



Ann Richardson 



McDonough High School 
Maryland 



Curriculum Specialist 



Visual and Per- 
forming Arts 
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Sal fy Pancrazio, Ph.D. 



REVIEW AINI^^RECOMMENDATIONS PANEL (Cont»d) 



AFFIIJ^ATION 



Illnols Office of 
Education 




POSITION 



Manager, Research and 
S+a+ls+lcs 



ni<^n!PLiNE 



CEIS, Committee . 
on Eva! uatlon and 
Information Systems 



Robert Smith 



Lou Zuccarel 1 1 



Washington, D.C. 



Northern Virginia 
Community Col lege 



Executive Director 
CouncI I for American 
Private Education 



Associate Professor; 
Program Head Fire 
Protection Technology 
Program 



Council iPor 
American Private** 
Education 



Protective Services 
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LIST OF INSTRUCTIONAL PROGRAM CATEGORIES 



Agriculture 

01. Agribusiness and Agricultural Production 

02. Agricultural Sciences / 

03. Renewable Natural Resources^ 

Archlte.cture and Environmental DesI^^^ 

04. Architecture and Environmental Deslgn^^ 
Area apd Ethnic Studies 

05. Area and Ethnic Studies 
Business * 

06. Business and Manag^ent 
.07* Business and Office - 

08. Marketing and Distribution 

« 

Communications 

09. Communications 
10* Communication Technologies 

Computer and Information Sciences 

11. Computer and Information Sciences 

Consumer^ Personal, and Miscellaneous Services" 

12. Consumer, Personal, and Miscellaneous Services 
Education ( 

13* Education 

Engineering 

14* Engineering 
^ 15. Engineering and Engineering-Related Technologies 

Foreign Languages 

' 16. Foreign Languages 



Health 



17. Allied Health 

18. Health Sciences 
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Home Economics 




19 



20 vocational Heme Economics 
Industrial' Arts 

2K Industrial Arts 

Law 

22 • Law 

Letter^ 

23. Letters 
Libera I /Genera I Studies 

24. Liberal/General Studies 

Library and Archival Sciences 
p 

25#'' Library and Archival Sciences 
Life. Sciences 

26. Life Sciences 
Mathematics ^ 

27* Mathematics 
MM Itary Sciences 

28. MI I Itary Sciences 

29. Military Technologies 

Multl/Interdlsclpl Inary Studies 

30. Multl/Interdlsclplln^ry Studies 
Parks and Recreation 

31. Parks and Recreation 
Personal and Social Development 

32. Basic Skll Is 

33. CItlZvenshtp/Ctvtc Activities 
iA. Health-Related Activities 

35. Interpersonal Skills 

36. Leisure and Recreational Actlvltl 
37 • Personal Awareness 



\ 



Philosophy, Religion, and Theology' 

38v^ Philosophy and l^el Iglon 

39. Theology 

Physical Sciences i5 

40. Physical Sciences 

41. Sciences Tecfinology 

Psychology 

42. Psychology 

Public Affairs and Protective Services 

43. Protective Services 

44. Public Affairs 



Social Sciences 




45. Social Sctjences 
Trade and Industrial' 

46. Construction Trades 

47. Mechanics and Repairers 
48« Precision Production 

49. Transportation and Material Mov 

Visual and Performing Arts 

50. Visual and Pqrforftilng Arts 



APPENDIX C: GEOGRAPHICAL DISTRIBUTION OF SLBSAMPLE 
OF LOCAL COURSE CATALOGS (1979-1981) 



37' 



APPENDIX C: GEOGRAPHICAL DISTRIBUTION OF SUBSAMPLE 
OF LOCAL COURSE CATALOGS (1979-1981) 



Cal Ifornia 

Illinois 

Ohio 

Michigan 
New York 
New Jersey 
Iowa 

Mary land 

Pennsy Ivatila 

Connecticut 

Kentucky 

Virginia 

Florida 

Nortf) Carol Ina 

Oregon 

Arizona 

Missouri 

Alaska 

Hawal i 

DIs+rl ct of Col umbia 

Nevada 

Utah 

Nebraska 
Georgia 

Total: 



Number of Catalogs Analyzed 
8 
7 
5 
3 
3 

'r 3 
2 
2 
2 

^ 2 ' 
2 



52 



38 



t 
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'CROSS REFERENCES FOR CLOSELY RELATED PROGRAMS IN 
SECONDARY SCHOOL CURRICULA 

.This table Is designed to enable usersyto locate courses In the CSSC that 
may be taught within several dlffet^ent disciplines or program , areas In 
secondary curricula. The laterdlsclpl t^ary content of many courses and, the 
variance In school districts' placement of courses within their curricula 
make assignment of single classification codes to course titles dl fflcult. 

The placement of a course within a particular four-digit program area In 
the CSSC does not eliminate the possibility of the same course being 
offered within a number of other four-digit areas as well. The cross 
references app^rlng below were Identified by the Review Panelists as being 
areas of substantial overlap of program content Jn secondary education. 



For Related Cgurses In: 



See Also: 



08.02 Business and Personal Services 
Marketing 



09,02 Advertising 



09.01 Communications, General 



10*01 Comiqun I cation Technologies 



10.01 ' Communications Technologies 
15.0? Electrical and Electronic 
Technologies 

23.05 Creative Writing, 
50*05 Dramatic Arts 

50.06 FllmVts" 



11 .02 Computer, Programming 
1 1 • 03 Data Prbcess I ng 



07.03 Business Data Processing 



16.01 through 16.11 Foreign 
Languages 



15.01 Area Studies 

15.02 Ethnic Studies 



22.01 Law 



43.01 Criminal Justice 
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23.01 " English, General 
27.03 Applied Mathematics 

0 

> 

34.01 Health Related Activities 



" 42.01 Psychology, General 
45.01 Social Fclences, General 



45.07 Geography 

45.08 HUtory ^ 

45.10 Political Science and 
Government 

45.11 Sociology 

50.07 Fine Arts 

50.08 Graphic Arts Technology 



30.04 Humanities 
50;05 Dramatic Arts 

07.01 Accounting, Bookkeeping and 

Related Programs 
11.01 Computer and Information 

Sciences, General 
27.01 Mathematics, General 

17.01 through 17.08 AllleJ Health 
26.01 through 26.07 Life Sciences 
30.01 Biological and Physical 
Sciences 

35.01 Interpersonal Skills 
37.01 Personal Awareness 

30.04 Humanities and Social 

Sciences 
42.01 Psychology, General 

05.01 Area Studies 



22.01 Law 

33.01 Citizenship 

30.07 Women's Studies 

04.02 Architecture 

09.04 Journalism 

48.02 Graphic and Printing 
Communication 
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